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ftfifiESSEENT AMD EVAlBATION STAFF 


Tha Assessment snd Evaluation Staff is rcsponaiM. for 

rsss.-,ss; s-asrss kt-as . si-sasrsi* «-» «? 

In carrying out this luajousibmtjr. tha eanaral functions and activities of the Staff are to: 

(a) Provide the Director of Training with qualified professional psychological assistance wherever in- 
dicated and requested. 

(b) Organise , supervise, and administer adequate program®, staffs, and facilities within the United 
States to provide competent professional psychological services,, 

(o) Provide assistant and professional staff supervision for authorised professional psy^Oogicai 
programs sondasted overseas 0 . 

(d) Provide profeeeional psychological aaeietance to the 
ponente of the Agencyvhcn requested, with the advice end consent of the Director of Training. 

M Organise, supervise and administer ap Assessment Brandi with sjmcific functions to indudes 

a) The intensive psydJblo^Sl assessment of individuale rrferred, to telp^termine 
their 'suitability for particular types of positions, particularly those of a critical o 

sensitive nature 0 

(2) The development of a professional staff capable of aeoompliddng psychological 
assessments,, 

(3) The analysis of psychological factors important for success in intelligence work. 

( 4 ) . The systematic study of assessment procedures to determine the effectiveness of 
the methods used and to improve and refine present techniques. 

(5) The development of new techniques for use in psychological assessment „ 
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(f) Organise, supervise, and administer a Training Evaluation Branch with specific functions to include 

(1) Participation in the analysis of genoral training requirements, primarily to 
determine how various psychological techniques, may best be utilised • 

(2) The development, direction, supervision and coordination of training equation 
procedures* The aim of this program is to provide a meaningful and complete record of 
what a student learned and what personality characteristics he revealed during twining* 

This record would be used by: 

(a) the Profe ssional Selection Panel in determining career suitability at the 
end of the probationary period* 

(b) the Office of Training, in evaluating and improving its own program. 

(e) the student s s supervisor or sponsor in p l a nni n g general career development 
and specific assignments* 

(3) The development of new techniques for use in tra inin g evaluation 

(4) The systematic study of training evaluations to determine their effectiveness and 
usability means of improving them* 

(5) The development of professional psychological personnel to assist instructfcnal 
personnel in analysing course content where appropriate, in developing objective testing 
materials, in evaluating teaching techniques and in counselling students with lemming 
problems* 

(g) Organize, supervise and admini ster a Research and Validation Branch with specific functions to 
include: 

(1) Systematic review of all research work undertaken by the Staff to insure that 
highest professional standards are maintained* 

(2) Ma intenanc e of liaison with all sources conducting psychological research outside 
the Agency to certain that new developments and new techniques may be exploited and 
further developed by the Staff* 
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(3) Rendering statistical services necessary to carry out the research projects of 
the Staff. 

(4) Coordination of all research studies in accordance with priorities established 
by the Chief of the Staff. 

(5) Establishment of consistent reporting methods. 

(6) Establishment and malntenanoe of records basic to the activities of the Staff. 

(7) Development, improvement, and monitoring of (a) the SOD testing program, (b) the 
Jot testing program, (c) the language aptitude testing program. 

(3) i/Bvaloroant of nev testing and research programs as required. 

(9) Establishment and development of a staff capable of rendering suitable tech- 
nical support to the other branches in experimental design, statistical evaluation, aae&ne 
record procedures, and other technical matters. 

9 £& m&s&m 

Accomplishments 

For the purposes of this paper, the accomplishments of the fiscal year ending 30 June 1953 are divided into 
two phases. Professional and Administrative. 

(A) Accomplishments : 

(1) During the fiscal year just past, the Assessment Brandi performed a total of 407 assessments. 

(83 additional cases were scheduled but were cancelled or failed to report.) An assessment Involves two 
1U11 days for the individual assessed, plus the necessary time for the assessment psychologist to evalu- 
ate the test results and to prepare the fined report. Experience indicates that each assessment represents 
1 1/2 to 2 1/2 day 8 3 effort for the assessment psychologist. On the average, four assessment psychologists 
each conducted two assessments per week. 

The very nature of the professional problems involved contributes most to the number of man-hours 
required for each assessment. Time is also needed for experimental derivation of some of the processes. 
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and for the training of even generally competent people to bring them to the high Arencv standard Tin* 
special difficulties la assessing deeply covert cSefalso tend to ted^e toe SnS tea? mSI^cSio- 
gist can assess,, An intensive assessment program will always be tine consuming, but the value of the 
time spent is reflected in better select ion :f or sensitive and critical assignnentso 

“ er !, takan to P^vide a systematic check on the value of the asses- 
P^ 8 + is - ftect " d a PP° intment of a research-liaison comoittee by the DD/P 

to work with A & E staff personnel in implementing follow-up studies of the effectiveness of assessment 
It has not yet been possible to implement this new Agency policy by undertaking a specific study „ 


( 3 ) 


Considerable progress was nade in working out a basic program of assessment with resultant 

LX Doth In XhA mml'f'hv n-T +V» aaaeanA*vf - 1J 


Impro Yemen t both in the quality of the assessment and its reporting 


25X1A14a 


25X1A14a 


very promising 


^^^(4^Consigrable work was accomplished on specific phases of the assessment process : 

revised twice and is in use in three different programs. A 

trled ont for modification 0 A test for msasurl^" ability to anaW 

^ complex , ^ was proved for our purposes 0 All tests in use have bee^stematicaljyti- 
developed^ ^ n ° raS topt current for our population. Two new Situation tests or "live* problems'* ’ire 

\5 ) Over 1,000 training evaluations were processed through the Training Evaluation Branch anrf 

r8P0rtS “ — “"T *»«— — Tpeclally conn- 

(6) A major accomplishment during the year was the development and initial tryout of a 
^ f» r evataattog s t»dent B in training. The evaluation forTe^C il tSa^d^ '.t%% £T 

ai MUr ff pl T s “ 9 bein e completed for extension to all Office of' 
i raining courses. Many problems are yet to be solved for this system. 
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(7) The library of objective test items was reviewed and the items re class if led c (This library is used 
in preparing tests to measure what is being learned in the various course So ) 

(S) lectures and consultation concerning training evaluation problems were given 8 



(9) Testing of all students entering training was a major program begun during the past year* This pro- 
gram was devised to produce information which could be used for the following purposes: 


(a) to produce more meaningful training evaluations (see the functions of the 
Training Evaluation Branch) 

(b) to select and assign students In training 

(c) to enable instructors to adapt their teaching to the capabilities of the staff 

(d) to evaluate individual problems which might develop during trainings 


During the last six months of the fiscal year, 368 persons were tested as they actually entered v- 
a training program at the basic stages* During the last quarter of the fiscal year, 158 additional persons - 
were tested as they entered on duty in the Agency, in anticipation of their entrance into the basic courses* 1 


(10) Rarticipation in the selection of candidates for the Junior Officer Training program (JOT) was - ^ ^ 
another major activity during the fiscal year* A new battery of tests was developed and a total of 263 po- 7 £ 5 

tential candidates were given a day 3 s testings The results and interpretations of these tests were transmitted 
to the Chief of the JOT proermatoaidh^^^^ngfteal^lectiOTsl^vAologistafixmtheA&BStAff 
administered these tests 


CJ.) The problem of testing and assessing foreign personnel in the field received study during the year, 
but work was limited by lack of qualified personnel* (One staff member spent the entire year overseas par- 
ticipating in one such program*) The overseas program in Western Europe was terminated due to factors beyond 
the control of the A & E Staff* However, the experience of this unit aroused g re a t interest and resulted in 
more requests for A & E assistance than can be supplied by the present staff* A program for the Far Eadb has 
been projected and plans are underway for a survey of needs so that professional assistance can be rendered* 
However, Agency-wide interest in this type of program has created the danger that programs will be introduced 
prematurely, without the professional study and control essential to their success. 
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(12) A source of considerable concern was the ineraass in /us* a -p 
in areas outside our regular assessment site The an*t in^iZt f 5?®“* for _ ass ®®f a8 nts of deep cover personnel 
any of our other servioe ® lu h f° st ^ time ^ for this service exceeds tht for 

The majority of these cases were 86 s Pfcial assessments of this type were conducted. 

S0l0cted sites 111 but others were done 

captions about the role of psychological anA *_*!” bslpful 0 This has done naich to dispel aisoon- 

vhere the need eight otherwS haw bS* ^riSd. tas resnltea *» !«>"!* »«eal attention 

of thil^a^^BlL^ £ validity of asneeanente, end the general aooeptano 

divieione haw attBBptBdTLS «“* *>velop«i tvo 

systematic way has yet been developed to obtain fa£^?i3^tim ™ lporaazmBl « oin e oweeas. No 

comments like the following are received: ^ P information on all persons assessed, but voluntary 


(a) 


2? ° f “? tlaly "“"““Jation by aeaessMnt, and 

high w“ SoS?1L f “* ^ — of —v *u —r fcoure of 


expense was involved in getting them back to the United States e n 

the Agency o These requests have* Inc^ed^J^^^^p^alT^resea^ 68 ?^? 111 *“*5°® to varlou « components o 
as psychological warfare and FI operations " as well n ^° 2 278 <9a 5 ch studies » 80,5 techniques in such areas 
assistance has also bean r^dered^he i evaluations of proposals from outside sources. So® 

dation. Various oonfe^f^ ° m< * ^ *he area of research anfval 

on psychological problems and techniques. rS ProcurenBnt Officers of the Personnel Offio 

to tliw^^riSf 1869 aptitudtt Uatia g battery has been administered to 101 individuals and results reported 
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(B) Administrative Aocompl l^hmew+.g . 

Dlaciig^ASetlfSde/t^D^R^Thf th ! removal of the Staff from under the DD/m(S), 

fc ”‘ ar “ ssfass 

duplication of IfSrt. P °° 1 * ttis ““ resnlt8d ** Idcreaaed efficiency through the elimination of 

visioiPof ^SSSShT’^ for ”* efrectlve 

Salaiy^leaels^mre^e q ^^^ed r and^nositions^were^defhied re “*»!?»*«- X**—. 

his duties and responsibilities 0 80 ^ eadl individual has a good understanding of 

of recordable ^Sf.ltaS^arf^gar^r^ 8 **?* wl»«™r poaaible. Duplication 

hand. m central mster file astern will provide guide references to files on 

be made^a pLt ^Agency** Ar^iveJ ^^readyh^ff y^n2 ed & r0cord of wrk done ^ the Staff can 

formerly maintained by the Personnel Office is b«W in+i^ ^+^ 4 °+* a sep ?? ,a ' te fil ® of assessment reports 

-• Musa arasss sss: sssfs.“ =vsse.” ■— — «— 

IBM cards 5“ Ultete »°? optional and research activities, 

conducted during the period Close -_ + . / allpre-course and JOT testing, and all training evaluation 

and the ‘’ ,, *" eD tl ” ASBS “ f »dhiT„ccrds S 
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1110 system for scheduling assessments from the clandestine offices was completely revised and 
published procedures were issued. This procedure establishes a priority system, and clearly defines the 
scheduling process. 
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Objectives &SL Eigcfli Years 1254 fiz£ 125£ 


(A) £cg£§§8lgDal flajggjto?, 

(1) Fiscal 1254 

a. Augment the professional staff to the point vhere it can adequately 
discharge its expanded duties, A special recruiting trip Is planned 
to accomplish this. 

b. Increase the effectiveness of the assessment process by; 

1. Revising the referral form. 

2. Further systematizing what is reported, 

3 . Revising the procedure so that the professional s kills of 
■ore members of the staff are brought to bear on the final 
Ju dgm en t concerning the individuals assessed. 

4* Better organizing the efforts of Junior staff members. 

5 o Systematically collating information concerning procedures used, 

c. Implement the recently established policy concerning ev aluation of 
the assessment process by surveying means of securing estimates of 
success on the Job. 

do Initiate more active programs to develop professional st/jff in those 
directions which best serve Agency needs, 

e. Introduce the newly developed core procedure for training evaluation 
in all group training o our see, 

f • I mp l em ent the training evaluation policy concerning the use of objective 
measures by assisting instructors to develop objective tests of the 
knowledge they teach in each course, 

g. Develop a procedure to identify special problems or special talents 
while individuals are in training! and develop a method of 
reporting these findings. 
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h - crsi&S" 14 «"■*- - »«-* 

** *££ “ MeTO tetter 
J> *"“« proer “- 

** for — — 1 

*• - :r«Ar“ 

m. Set . g procedure and pereonnel to maintain routine ralldity atudlee 
of the training evaluation program* 7 swiaiee 

g!®** fOT 80 ” enlD e ol Indigenous pereonnel. It „m be 


25X1 C2d 


Make a survey of 

reouire th« TTTrZT P robles re *^reH^E^hlH!ill 
require the following tine overseas i 

(a) two weeks by Chief, A and E 

b) l“^n th8 by Aotljl S CMef . Besearoh and Validation Branch, 

(c) up to aluc rnontha by an additional staff member 

2 ' ££L°"‘J 40 dete ™ 1 '‘< i KhrtJiW teat reiulta can be 

^SSSfeSES 7 ^ dlfferrat CUltuM8 - «• “ ^ t< 
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(2) Fiscal 1955 

a* Undertake further studies on the assessment process, the nature of 
will be determined by the results obtained during 1954c 

b. Initiate further follow-up studies to evaluate the success of the assess- 
ment program. 

0. Continue the professional development program. 

d* Begin a program for developing measures of skills, attitudes, and 

personality characteristics for purposes of training evaluation, taking 
up each course in accordance with priorities set by Director of Training. 

e« Begin a program for development of better situational tests for use in 
assessment. 

f c Begin follow-up studies for evaluating ECD and JOT testing programs. 

g. Continue work (through contract) on language aptitude testing program. 

h. Continue testing Agency personnel for purpose of establishing more 
meaningful norms. 

1. Continue routine validity studies of training evaluation. 

Continue studies (both in service and contract) aimed at developing a 
systematic and widely applicable procedure for screening indigenous 
personnel. 

(B) T ^ at ratjye Ob jectives 

(1) Ekaal 1254 

a. Completion of the record system revision inaugurated during 1953 . 
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b„ Improvement in the system of routine internal reports, to permit better 
control and planning of A & 3 efforts . 

Co initiation of a study to improve the methods of reporting results of 
training evaluation. 

d. Development of an SOP to facilitate operations of the Staff. 

( 2 ) 

a. In cr ease general efficiency of operation with particular reference 
to the use of machine methods. 

b, i nstall the system of routine reports to be developed during 1954c 
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